Adequacy of Bounded Exhaustive Testing and Incomplete Oracles for Elusive Bug Detection
نویسنده
چکیده
Elusive bugs (EB) are not reliably discovered using standard methods such as black and white box testing. Bounded exhaustive testing (BET) is a promising approach for their detection. A generic EB fault model is introduced which is used to consider the adequacy of BET for EB detection. BET requires the use of an automatic oracle. Situations in which automation may only be practical with the use of an incomplete oracle are considered. Failure models are used to evaluate effectiveness of incomplete oracles.
منابع مشابه
Test Frameworks for Elusive Bug Testing
Elusive bugs can be particularly expensive because they often survive testing and are released in a deployed system. They are characterized as involving a combination of properties. One approach to their detection is bounded exhaustive testing (BET). This paper describes how to implement BET using a variation of JUnit, called BETUnit. The idea of a BET pattern is also introduced. BET patterns d...
متن کاملReducing the Costs of Bounded-Exhaustive Testing
Bounded-exhaustive testing is an automated testing methodology that checks the code under test for all inputs within given bounds: first the user describes a set of test inputs and provides test oracles that check test outputs; then the tool generates all the inputs, executes them on the code under test, and checks the outputs; and finally the user inspects failing tests to submit bug reports. ...
متن کاملShekhar Bangalore Jagannath
Bounded-exhaustive testing is an automated testing methodology that checks the code under test for all inputs within given bounds: first the user describes a set of test inputs and provides test oracles that can check test outputs; then a tool generates all the test inputs, executes them on the code under test, and checks the test outputs; finally the user inspects the failing tests to submit b...
متن کاملApplicability of BET to Elusive Bugs in Diverse Application Areas
The basic principles of Bounded Exhaustive Testing (BET) are reviewed, as well as the concept of an Elusive Bug (EB). Initial work on the application of BET to EB's previously indicated that it provides a new and promising approach to this problem. A four-part BET/EB oriented test framework involving: fault model development, BET test generation design, failure model identification and automate...
متن کاملTranslating Object-z Speciications to Passive Test Oracles Translating Object-z Speciications to Passive Test Oracles
This report describes the translation of formal speciications of container classes to passive test oracles. Speciically, we use Object-Z for speciications and C++ for oracles. We discuss several practical issues for the use of formal speciications in test oracle generation. We then present the translation process for three passive oracle models and evaluate how each model satisses our goals of ...
متن کامل